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psj . Abstract 
■ 

Weighted and controlled frames have been introduced recently to 
improve the numerical efhciency of iterative algorithms for inverting 
' the frame operator. In this paper we develop systematically these no- 

I tions, including their mutual relationship. We will show that controlled 

■ frames are equivalent to standard frames and so this concept gives a 
I generalized way to check the frame condition, while offering a numer- 

■ ical advantage in the sense of preconditioning. Next, we investigate 
[ weighted frames, in particular their relation to controlled frames. We 

^ ■ consider the special case of semi-normalized weights, where the con- 

cepts of weighted frames and standard frames are interchangeable. We 

■ also make the connection with frame multipliers. Finally we analyze 
weighted frames numerically. First we investigate three possibilities 
for finding weights in order to tighten a given frame, i.e., decrease the 
frame bound ratio. Then we examine Gabor frames and how well the 
canonical dual of a weighted frame is approximated by the inversely 
weighted dual frame. 

Keywords: controlled frames; weighted frames; frame multipliers; Gabor 

frames; preconditioning; dual frames. 

AMS Subject Classification: 42C15, 42C40; 65X60 



1 



1 Introduction 



In practice, the frame bound ratio of a given nontight frame can often be 
reduced by weighting the elements. The so-cahed weighted frames, i.e., 
frames (tpn) with complex weights (u;„) such that the sequence {ojktpk) is 
again a frame, were introduced in Ref.[7j to get a numerically more efficient 
approximation algorithm for spherical wavelets. By decreasing the ratio of 
the frame bounds, weighting improves the numerical efficiency of iterative 
algorithms like the ^ frame algorithm^ \10\ for the inversion of the frame op- 
erator. The same paper [7j introduced and used controlled frames, that is, 
a frame {ipn) and an operator C such that the combination of C with the 
frame operator L is positive and invertible. Since these concepts were used 
there just as a tool for spherical wavelets, they were not discussed in full 
detail. 

In this paper, we will develop the related theory and derive some prop- 
erties used in Ref.[7] without proof, as well as give the results of numerical 
experiments. Section [2] contains some preliminary results. In Section [3] we 
will show that controlled frames are equivalent to standard frames and so 
this concept gives a generalized way to check the frame condition. In Section 
Hlwe investigate weighted frames. We will put some emphasis on the mutual 
relationship between the two concepts, showing in particular that weighted 
frames cannot always be considered as controlled frames. We also investi- 
gate how these concepts can improve the efficiency of iterative algorithms 
for inverting the frame operator. As a special case, we consider weights 
bounded and bounded away from zero, for which the concepts of frames 
and weighted frames are interchangeable again. The connection to frame 
multipliers will be addressed briefly. 

In the last part we will investigate the concept of weighted frames in 
numerical experiments. In Section [5] we analyze three different choices for 
weights with the aim of making frames tighter, i.e., reducing the quotient 
of the frame bounds. We give the results of some numerical experiments, 
showing that these weights very often improve the condition number of the 
frame operator matrix. We see that redundancy is an important parameter 
for the optimality of these weights. In Section E] we examine the computa- 
tional behavior of weighted Gabor frames. In particular we investigate how 
well the canonical dual weighted frame is approximated by the inversely 
weighted dual frame. We see that the error depends linearly on the amount 
of weighted elements and the redundancy. 

2 Preliminaries 

In this section, we collect the basic notation and some preliminary results. 
Throughout the paper, is a separable Hilbert space, with inner product 
(.,.), linear in the first coordinate, and norm ||-||. We denote by I the 
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identity operator on 7i. Let B(TCi,7i2) be the set of all bounded linear 
operators from TCi to 7i2- This set is a Banach space for the operator norm 
ll^ll = sup The adjoint of the operator A is denoted by A* 

and the spectrum of A by cr{A). We define GL{Ti.i,TC2) as the set of all 
bounded linear operators with a bounded inverse, and similarly for GL{7i). 
Our standard reference for Hilbert space and operator theory is Ref.|llj. 

2.1 Frames 

We collect here some known facts about frames, in a form suitable for us. 
For more details on this topic, see for instance Refs.[9] or |10] . 

Definition 2.1 A sequence ^ = (V'n, n G F) is called a, frame for the Hilbert 

space if there exist constants m > and M < oo such that 

m||/f ^ E K/,V'n)|'<M||/f ,V/GH. 
ner 

m is a lower, M an upper frame hound. If the bounds can be chosen such 
that m = M, the frame is called tight. 

The optimal bounds rriopi, Mop* are the largest m and smallest M that fulfill 
the corresponding inequality. 

Definition 2.2 Given a frame ^ = {ipnin G F), Lijr : 7i ^ 7i denotes the 
(associated) frame operator L^^,{f) = ^ {f,ipn) V'n- 

n 

If there is no risk of confusion, we will omit the index and write L instead of 
L^. For any frame, L is a positive invertible operator on all of Ti, satisfying 
the inequalities m / ^ L ^ M / and M~^/ ^ ^ m~^/. Furthermore, 

Theorem 2.3 Let ^ = (V'n) be a frame forTC with bounds m, M > 0. Then 
nj is a frame with bounds M m "'^ > 0, the so-called 

canonical dual frame. Every / G W has expansions f = ^ (f,ipn)ipn o-nd 
_ ner ^ ' 

f = Yl {fii'n) 'il^n, 0-nd both sums converge unconditionally in TC. 
ner 

We will use so-called frame multipliers.^ These are operators defined 

by 

Mm,^,*/ = ^ mk if, tpk) 4>k 
k 

for the frames ^ = ('(/'„,) and ^ = {(j)n) and the weight sequence m = {m}.). 
We shorten the notation by setting Mm,* = Mm^.!,^,!,. 

Among all frames, a privileged role is played by Gabor[T6] and wavelet 
frames. [12] For future use, let us repeat the definition of the former. 
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Given a,b > 0, a Gabor frame over the regular lattice A = 6Z is 

a family 

G = {gk,i)k,i ■= {MibTkag, l,ke Z^} 

that fulfills the frame condition and whose elements are translated and mod- 
ulated versions of a given window function g S L^(R'^). Here the operations 
of translation and modulation are defined by: 

Ta^fit) = fit - x) and M^fit) = e'^^'^'fit), t,x,^G M'^. 

We will denote as A = (r, w) G A the time-frequency shift, defined as 

TT{X)g = M^Trg. 

We shall discuss some concrete examples of (weighted, discrete) Gabor 
frames in Section [6l 

2.2 The bounded and boundedly invertible positive opera- 
tors GL^+\n) 

A bounded operator T is called positive (respectively non-negative)^ if (T/, /) > 
for all / 7^ (respectively {Tf,f) ^ for all /). Every non- negative oper- 
ator is clearly self-adjoint. If A G B{7i) is non-negative, then there exists 
a unique non-negative operator B such that = ^.|15j Furthermore B 
commutes with every operator that commutes with A. This will be denoted 
hy B = ^1/2. Let GL^+\n) be the set of positive operators in GL{n). 
The following result is needed in the sequel, but straightforward to prove: 

Proposition 2.4 Let T : 7i ^ 7i be a linear operator. Then the following 
conditions are equivalent: 

1. There exist m > and M < oo, such that m / ^ T ^ M /; 

2. T is positive and there exist m > and M < oo, such that m ||/||^ ^ 

||TV2/||'<M||/f; 

3. T is positive and T^/^ G GL{H); 

4- There exists a self-adjoint operator A G GLiTi), such that = T; 

5. T e GL^+\n); 

6. There exist constants m > and M < cxo and an operator C G 
GL^+\n) such that m'C ^ T ^ M'C; 

7. For every C G GL^^\7i), there exist constants m > and M < oo 
such that m'C ^ T M'C. 
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Definition 2.5 Given T G GL^^\7i), any two constants my, My such that 

are called lower and upper bound ofT, respectively. If mj' is maximal, resp. 
if Mt is minimal, we call them the optimal bounds and we denote them by 

The upper and lower bounds are clearly not unique. 

The following results are easily proved using Proposition 12. 4t 

Corollary 2.6 Let T G GL'^+\n). Then 

1. \\T\\ = m5?^*\ 

2. (t{T) C [mj^, Mj^], for any lower, resp. upper, hounds. 

Corollary 2.7 For T G GL^+^H), the numbers my-i = M^^ and M^^-i = 
m^^ are bounds for T^^ . In particular \\T~^\\ = l/m^^*\ 

Corollary 2.8 Let S, T G GL^~^\7i) be commuting operators. Then T ad- 
mits as lower and upper bounds {^j^, ^^^^) o.iT'd ST admits (m^rriT, M^My). 

2.3 Numerical issues 

A well-known algorithm to find the inverse of an operator is the Neumann 
algorithm, which is based on the following property: 

Proposition 2.9 Given two Banach spaces *Bi,*B2, if U : iBi 532 is 

bounded and \\I — U\\ < 1, then U is invertible and = {I — U) ■ 

n=0 

Furthermore \\U^'^\\ ^ (1 - 

A way to improve the numerical efficiency of an iterative algorithm for 
solving a linear system of equations is preconditioning. [HI dH] Instead of 
solving the linear system of equations Ax = b, one solves the system PAx = 
Pb for a properly chosen preconditioning matrix P. 

A 'clustered spectrum' yields a fast convergence as well as guarantees a 
small condition number, [T7] k{A) = ||^~^|| ||^||, since k{A) = CTn/cri where 
cj„ and (Ti are the largest and smallest singular values, respectively. 

Given an operator T G GL^^^iTL) its condition number is given by 



k{T) = \\T^'\\ \\T 



111 IIT^II _ T 



M 



{opt) 



Aopt) 



So we can use preconditioning by looking for an operator C such that 

McT ^ Mr 
k(C T) = < = k{T). 

mcT mT 
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3 Controlled frames 



Definition 3.1 Let C G GL{7i). A frame controlled by the operator C or 
C -controlled frame is a family of vectors ^ = {ipn G W : n G F), such that 
there exist two constants n)cL > and Mcl < oo satisfying 

mcL Wff ^ Yl ^) ^^") ^ Mcl \\ff , for all / G (1) 

n 

We call 

Lcf = Y,{^PnJ) C^n 
nGr 

the controlled frame operator. 

The definition above is clearly equivalent to CL G GL^~^^ ("H), so the notation 
is coherent with the one in the previous section. 

Proposition 3.2 Let ^' 6e a C -controlled frame in H for C G GL{7{). 

Then ^ is a classical frame. Furthermore C L = L C* and so 

ner nGr 

Proof. Let be a controlled frame. Then using the definition and Proposi- 
tion [Ml we know that Lc G GL{n). Let L = C-^Lc- Clearly L G GL{n) 
and 

Lf = G-' (E^^-/)^^-) =E<^-^)^« = ^/ 

VnGr / nGr 

Therefore L is everywhere defined and L G GL{7i). Thus \I' is a frame [lOj . 

By definition Lc is positive, therefore self-adjoint. So Lc = C L = = 
L*C* = LG* . □ 

Since every controlled frame is a (classical) frame, ([T]) yields a criterion 
to check if a given sequence constitutes a frame. Furthermore it becomes 
obvious from the last result that the role of Cipn and ijjn could have been 
switched in the definition of controlled frames. 

It is difficult to see in full generality which conditions are needed for a 
frame and an operator to form a controlled frame. But if G is self-adjoint, 
we can give necessary and sufficient conditions: 

Proposition 3.3 Let G G GL(TC) be self-adjoint. The family ^ is a frame 
controlled by G if and only if it is a ( classical) frame for 7i, and G is positive 
and commutes with the frame operator L. 
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Proof. Suppose C and ^ form a controlled frame. Then from Proposition 
13.21 it is clear that ^' is a frame and that L and C commute. Therefore 
C = Lc is also positive. 

For the converse implication, we note that, if ^' is a frame, then L E 
GL^+\n). Therefore CL = Lc e GL^+\n) and so Lc is positive. By 
Proposition El Eq. ([31]) is satisfied. □ 

Using Propositions 13.31 and 12.41 the following result is easy to show: 
Corollary 3.4 

(1) Let C be an invertible, self-adjoint operator and L be the frame oper- 
ator of Then, m / ^ CL ^ M / implies m C^^ ^ L ^ M C^^ 

(2) Let C £ GL^+\rL). Then, m ^ L M C^^ implies m / ^ CL ^ 
M / and ^ is a frame. 

This result shows the equivalence of Eqs.(3.11) and (3.12) of Ref.^Tj under 
the given conditions, which was stated there without proof. 

3.1 Numerical aspects of controlled frames 

As a short remark, we note that {Cipn) need not be related to a dual frame, 
except in the case M = m, when C = L~^ by necessity. But, for finding the 
canonical dual frame algorithmically from ([T]), we know that Lq is invert- 
ible. In particular this means that L~^C = {CL)~^ C = L~^. So finding a 
C such that ^ forms a controlled frame, with nice numerical properties, is 
equivalent to preconditioning. [19] This was the main motivation for intro- 
ducing controlled frames in Ref.[7]. For this to be effective, the bounds of 
the operator, which are clearly also bounds for the spectrum of the operator, 
should be close to each other. It is straightforward to show: 

Corollary 3.5 Let C be a self-adjoint operator and let ^ be a C -controlled 
frame. Denote by (mci, Mcl), M) and (mc, Mc) o.i^y bounds for the 
controlled frame operator Lc, the frame operator L, and the operator C , 
respectively. Then, 

(ij m = -— — , M = are bounds for L; 

Mc mc 



(a) m'r< = . . , M'r = are bounds for C : 

(Hi) = mmc, ^'cl = MMc are bounds for Lc- 
If two bounds are optimal in the above equations, the resulting third one is 
optimal, too. 

This means that, if we find a C such that mcL — McLj we get a very 
efhcient scheme, in the sense that: 
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. The resulting algorithm is much more stable, according to the remarks 
made in Section [2T3l One has indeed n(Lc) ^ Mcl, 

\ •-^ / mcL 

. Let e := . Using a Neumann algorithm, we get a good ap- 

proximation of the inverse operator already in the first iteration gi. 
Indeed, ||/ - gi\\ ^ e ||/||cn. 

So, as stated in Ref.[7], although controlled frames and "standard" frames 
are mathematically equivalent, these different 'viewpoints' of frames give 
opportunities for efficient implementations. For general frames, it seems dif- 
ficult to find an appropriate preconditioning matrix, but for wavelet frames 
this technique is used in the above-mentioned paper. [7] For Gabor frames, 
a way to find advantageous preconditioning matrices is presented in Ref . [6] . 



4 Weighted frames 

Definition 4.1 Let ^ = {ipn : n G F) be a sequence of elements in Ti and 
{wn : n € F) C M+ a sequence of positive weights. This pair is called a 
w-frame of 7i if there exist constants m > and M < oo such that 

m||/f ^E^«l^/'^«)l'^M||/f . (2) 
ner 

Alternatively, given a sequence of complex numbers (u;„) C C, we call ^ = 
{tpn) a weighted frame if the sequence (u;„ Vn) is a frame0~ 

2 

The two definitions are clearly equivalent, by putting Wn = , resp., 
"^n. = \/w^.en, where € C with |en| = 1. 

Weighted frames are related to signed frames. |18j The latter are Bessel 
sequences coupled with weights {wn = ±1), that fulfill an inequality similar 
to Signed frames are equivalent to w- frames for which negative weights 
are allowed and the weights are bounded. In this paper, the sign of the 
weight is either not included or not significant for the definitions given above, 
and the main results in Ref. [18] also differ in focus from the ones given here. 

4.1 w- frames as controlled frames 

It is clear that, if an operator is diagonal on a given sequence and together 
they form a controlled frame, then the concept of weighted frame is just a 
special case of controlled frames. But we can show that we cannot get all 
possible cases of w-frames in that way and so we cannot apply the result in 
Section [3] to the general w-frame case. 

^The two terms 'weighted frame' and 'w-frame' were used interchangeably in Ref. [7]; 
here we make a difference. 
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Proposition 4.2 Let C G GL{7i) he self-adjoint and diagonal on ^ = 
(ipn) o-nd assume it generates a controlled frame. Then the sequence {wn), 
which verifies the relations Cif^n = Wnipn, is semi-normalized^ and positive. 
Furthermore C = M„ 



Proof: By Proposition 12.41 we get the following result for C^^^: 



^1/2 J 



^ M 



c 



As Cipn = Wnipn, clearly C^^'^ipn = \/w^ipn- Applying the inequalities above 
to the elements of the sequence, we get < mc ^ Wn ^ Mc. 

Clearly, the only possible operator C that could fulfill the conditions 
would be the multiplier 

cf = Yl (f, i'k) wki^k = M^,^^^f. 



□ 



The relation between controlled frames and weighted frames for non-self- 
adjoint operators C is not obvious. The reason is that, for nonexact frames, 
a definition by Uipn = Wnipn is not applicable. [5] 

4.2 Semi-normalized weights 

As a converse to the first part of Prop. 14.21 a frame weighted by a semi- 
normalized sequence is always a frame. Indeed, 

Lemma 4.3 Let {u>n) be a semi-normalized sequence with bounds a,h. Then 
if (ipn) is a frame with bounds m and M, then [iOnipn) is also a frame with 
bounds a^m andb^M. The sequence (^LJn~^'4^n^ is a dual frame of (iOnipn)- 

Proof. Since |(/,t^nV'n)P = \ujn\'^ \ {f,tpn)\'^ , we get 

^ •= ^lif^'^ni^njf = ^ \uJn\'^\{f,'lpn)\^ ■ 
n n 

Thus A ^ ft^EK/^V'n)!^ ^ ll/f . In addition, 

n 

A^a2j;i(/,V^„)|2^a2m||/f . 

n 

■^A sequence (c„) is called semi-normalized if there are bounds b ^ a > 0, such that 

a ^ \cn\ ^ b. 
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Figure 1: Comparing the canonical dual of a weighted frame to the reciprocal 
weighted dual frame. (Top left:) original frame. (Top right:) Weighted frame. 
(Bottom left:) Canonical dual of weighted frame. (Bottom right:) The canonical 
dual of the original frame, i.e., the frame itself weighted by the inverse weights. 

As Yl if, ^nipn) oJn'^i'n = Yl if^ i^n) i'n = /, these two Sequences are dual. 

n n 

Since uJn~^ is bounded, (oJn~^'4'n^ is a Bessel sequence dual to a frame. 
Therefore, [To] it is a dual frame of {tOnipn)- D 

Remarks 

1. The weighted dual frame is a dual, but not the canonical dual. As an 
example, consider the Parseval frame, i.e., self-dual frame, 

with weights {u>i, 002,(^3) = (^)1)2). Following Lemma (u>h~^ibi.) 
forms a dual frame, but it is not identical to the canonical dual frame 
(see Figure [1]) . The relationship between these two duals will be in- 
vestigated in Section [6] for the case of Gabor frames. 

2. Frames with weights {wn = ±1) fulfill the conditions of this Lemma, 
so they are always a frame with the same bounds. A dual frame is 
obtained just by applying the weights on the dual of the frame. This 
means that for a signed frame [18] that is also a frame, the dual can be 
easily calculated. 
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3. The condition for semi-normahzed sequences in Lemma 14.31 is neces- 
sary. It is in general not enough for the weights to be strictly positive, 
Wn > 0, for all n. To give an example, let (e„) be an orthonormal 
basis in Ti with index set N and ipn = ^^n- This is not a frame, since 
this sequence does not fulfill the lower frame condition. 

4. Using the sequence (tpn) above with the weights Wn = n also shows 
that in general a weighted frame need not be a frame, if the semi- 
normalized condition is not fulfilled. Furthermore this shows that 
Lemma 14.31 is not reversible. There are cases where weights that are 
not semi-normalized lead to weighted frames. There are even cases 
where unbounded sequences lead to weighted frames. 

4.3 Connection to frame multipliers 

The concept of weighted frames is connected to that of frame multipliers. [2] 

Lemma 4.4 Let = {ipn) be a frame for 7i. Let m = (m„) he a positive, 
semi-normalized sequence. Then the multiplier Mm, "J is the frame operator 
of the frame (y/m^ipn) CLnd therefore it is positive, self-adjoint and invertihle. 
Lf (nin) is negative and semi-normalized, then Mm,* is negative, self-adjoint 
and invertihle. 

Proof. 

n n 

By Lemma ll?3l {y/m^ipn) is a frame. Therefore Mm,* = is positive 

and invertible. 

2 

Let nin < for all n, then m„ = —\/\mn\ . Therefore 

Mm,* = -^{f, Vl^li^n) \[\^\^n = -L^^^^^y 

This can be extended to 

Theorem 4.5 Let (il^n) be a sequence of elements in TC. Let (wn) he a 
sequence of positive, semi-normalized weights. Then the following properties 
are equivalent: 

1. (V'n.) is a frame. 

2. Mm,* is a positive and invertihle operator. 
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3. There are constants m > and M < co such that 

m||/f ^ j;u;„|(/,V^„)|2^M||/f , 

neV 

i.e., the pair [wn),{'4^n) forms a w-frame. 

4. (y/w^ipn) is a frame. 

5. Mw'^iii' is a positive and invertible operator for any positive, semi- 
normalized sequence {w'^). 

6. {wnipn) is a frame, i.e., the pair {wn),{fpn) forms a weighted frame. 

Proof. By Lemma [331 (1) =^ (2). By Proposition E31 (2) (3). By 
the definition of w- and weighted frames we get (3) <^=^ (4). 

If (vun) is positive and semi-normahzed, so is the sequence {wn~^)- With 
Lemma 113] and apphcation of (1) =^ (4), we get (4) =^ (1). 

Use the sequence {vu'^) in the above argument to get (1) <^=^ (5). 

Finahy, (w^) is also a positive, semi-normahzed sequence, therefore the 
results above show the equivalence of (6) with the rest. □ 

Clearly this could also be easily extended to negative weights. 

5 Numerical results for general frames 

Now the practical question is obviously, how can one find weights such that 
a weighted frame becomes 'as tight as possible', such that the quotient of 
the bounds, i.e., the condition number of the frame, becomes smaller? This 
would give a way to calculate a dual in a more efficient way, although one 
does not obtain the canonical dual in general. In the sequel, we consider 
several possibilities, namely, i^-type weights and weights obtained through 
approximation by a frame multiplier, and we study the performance of each 
type of weight (in finite dimensions, of course). Many numerical tests have 
been performed, but, for the sake of conciseness, we present only the most 
significant results. 

5.1 First method: ^^'-weights 

We are looking for a measure of how important a single frame element is, 
how dependent it is on the other elements. With this in mind, given a frame 
^ = {ip^^ /c = 1, . . . , M} (M ^ cx)), put 
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This weight can be motivated as a control of the importance of the side- 
diagonals of the Gram matrix, G^i^ i = {ipkii^i)^ by comparing a diagonal 
entry to the sum of the squares of the other entries on the same line. This 
is reminiscent also of the generalized Welch bound found in Ref.[20]. For 
an orthogonal basis, the best weights should be given by the normalization, 

(2) 

which is indeed achieved by this weight, since in this case one has ujn = 

Un\\ 

In order to measure the influence of the power chosen in the definition 

(2) 

of , we have also investigated 



for p = A and p = 6. In other numerical experiences, it could be observed 
that p = 1, 3, 5 are not good choices compared to those ones. 
Finally we also test the following weight: 

(oo) ^ IIV'^II 



SUPfc |(V'n,V'fc)r 



5.2 Second method: Weights by best approximation with a 
frame multipher 

These questions can also be translated into the frame multiplier context: 
Can the identity be written as a frame multiplier? Can it be approximated? 

It is possible to find the best approximation of operators (in finite- 
dimensional discrete spaces) using the Hilbert-Schmidt norm (see Ref.jl] 
for an algorithm). The symbol of the best approximation is the weight 
^(mult) (jgfined as follows: 



OJ. 



(mult) 



M 

E 

k=l 



nk 



|2 



where is the matrix {G^^)^^ = \ {t/jqjtpp) p and ^ denotes the pseudo- 
inverse. The resulting matrix acts on the sequence {xk)k = (^(llV'/tll?^)^^ • 
This method corresponds to finding the weight such that the frame operator 
of the weighted frame is as similar as possible to the identity (in the Hilbert- 
Schmidt topology). 

5.3 Procedure and results 

In order to compare the efficiency of the various types of weights, we restrict 
ourselves to finite dimension d < oo and create random frames by finding M 



.(2) 
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random elements {M > d) and checking whether they span the whole space. 
For algorithms see Ref. (3] . In each case, we calculate the condition number of 
the frame operator of the weighted frame and compare the different weights. 
For each of them, we test whether it improves the condition number and 
whether it is the best among the given options. This is repeated 10.000 
times. 

In the following graphs, the color grey corresponds to the cases where 
the weighted frame improves the condition number of the frame matrix and 
black if the option is the best of the three given weights. So the sum of the 
black bars gives the total percentage of weights that improve the condition 
number. 

In Figures [2] and O we present the results for dimensionality d = 64 and 
d = 256, respectively, and increasing redundancy (= M/d). The graphs 
show the improvement of condition number by weights u;^^^ (= '2-norm'), 
(= 'inf.-norm') and uj^^^^^^ (= 'Multiplier'), respectively. Other tests 
have been made with lower dimensionalities d = 3 and d = 10. It turns 
out that, for these cases, the results are sowewhat erratic. Since such low 
dimensions are not very realistic for applications, we simply dropped them. 
Similarly, weights uj^^^ and iv^^^ lead to a higher computational load and give 
worse results. Thus these weights are no longer considered. 

Figure [2] shows the results for the parameters: d = 64 and M = 260, 512, 1024 
and 2048. The condition number is improved in 96.54%, 99.98%, 100%, 
resp.100% of the tests. 

In Figure [3] we have summarized the results for a set of parameters 
which may be more realistic for applications, namely, d = 256 and M = 
260,512, 1024 and 2048. Now the condition number is improved in 98.87%, 
99.97%, 100%, resp. 100% of the tests. 

5.4 Interpretation 

The hope, of course, was to find a clear trend with increasing dimensionality 
and/or redundancy, but the numerical experiments do not allow such a 
conclusion. 

For low dimension (d = 3 and d = 10, not shown here) and low redun- 
dancy, the weight a;(°°) and the weight by multiplier approximation w^™"^*) 
are sometimes good, but not always. For high redundancy, a;^^^ seems to be 
always a good guess, nearly always improving the condition number. 

For higher dimensions {d = 64 and d = 256), again the weight u;'-^^ 
nearly always improves the condition number, but, especially for higher 
redundancy, the weight by multiplier is the optimal solution of the three 
tested weights. 

As a general rule, however, in order to improve the numerical behavior 
of frames, the 'power weight' w^^^ should be used, because the weight by 
multiplier approximation is a highly complex algorithm and the weighting 
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Figure 2: Frames in d = 64: dimensions. Improvement of condition number by 
weights w^^^ (= '2-norm'), , uj^°°^ (= 'inf. -norm') and a;^™""^ (= 'Multiplier'). 
Top left: Frame with M = 65 elements; top right: M = 128; bottom left: M = 192, 
bottom right: M = 256. 

by the 'power weight' nearly always improves the condition number. Thus 
oj^"^^ is a good compromise. 

However, the only conclusion of these preliminary results is that the 
connection between optimal weight, dimensionality and redundancy should 
be further investigated. 

6 Numerical results for discrete Gabor frames 

In this last section, we shall examine the case of discrete Gabor frames in 
concrete situations. We denote a given Gabor system by G = {'K[X)g) and, 
for a given weight the weighted Gabor system by WG = {uj\'K{\)g). 

Furthermore we will use the notation DWG^Jgr the canonical dual of the 
weighted Gabor system, i.e., DWG = {oJxTT{X)g) and by iWDG the dual 
frame weighted with the reciprocal weights, i.e., iWDG = {jj^t^Ws) ■ 

According to Lemma 14.31 foi' semi-normalized weights, iWDG is a dual 
frame of WG, but not necessarily the canonical dual. In this section we 
investigate how close these two duals are to each other, i.e., how well iWDG 
approximates DWG. The rationale behind the examples is the following. 
Among all possible duals, the canonical one is the unique one that satisfies 
the minimal norm condition. However, it is often difficult to compute. On 
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Figure 3: Frames in d = 256 dimensions, with the same conventions as in Figure 
\^ Top left: Frame with M = 260 elements; top right: M — 512; bottom left: 
M = 768; bottom right: M = 1024. 

the contrary, iWDG is much easier to evaluate, and thus could be used as a 
convenient substitute for DWG. 

We treat the cases with several different windows, in dimension d = 144. 
In addition, we consider our frames with M elements as d-periodic. Explicit 
results will be given for a Gaussian, a Hanning and a Bartlett window. 
Similar computations have been performed also for a Blackman window and 
B-spline windows of order 3 and 5, but the results are not significantly 
different, so we will skip them here. 



(a, 6) 


Gaussian 


Hanning 


Bartlett 


(12,9) 


2.5041 


2.8609 


4.9648 


(9,8) 


1.4258 


2.0000 


3.9512 


(8,6) 


1.1324 


1.1603 


1.5612 


(6,6) 


1.0151 


1.1266 


1.4483 


(6,4) 


1.0075 


1.0000 


1.0857 


(4,4) 


1.0000 


1.0000 


1.0375 



Table 1: Frame bound ratio (M/m) of the Gabor frame G calculated for the given 
windows and time-frequency shifts. 

Our frame elements (atoms) read as gt^i = MibTkaQ, where fc = 0, 1, . . . , ^ — 
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1 and / = 0, 1, . . . , ^ — 1. Thus the number of frame elements is M = rd, 
where r := d/ab is the redundancy. Six pairs of time- frequency shift param- 
eters are considered to construct the lattices, namely, (12,9), (9,8), (8,6), 
(6,6), (6,4), (4,4), with redundancy 1.33, 2, 3, 4, 6, 9, respectively. The 
frame bound ratio for the Gabor frame G calculated for each of the given 
window functions and time-frequency parameters are presented in Table [H 
To investigate the error of approximation DWG by iWDG, we consider 
the relative error in Hilbert-Schmidt norm of the two synthesis matrices: 



\iWDG - DWGys 
||£>VFG||hs 



{uJXlT{X)g) 



X 



The formula is related to the notions of 'quadratic closeness' [21], and 'Bessel 
norm'. [2] 

To start with, let us consider a periodized Gaussian window g of length 
d = 144 and the lattice parameters a = 12, 6 = 9, so that d/a = 12, d/b = 16 
and M = 192. 

We consider a weight that mimicks a local mask, such as the one used 
in Ref.[I] for enhancing the contrast in a picture of the Red Spot of Jupiter. 
Namely, we take the weight w equal 2 on the centered 3x3 block on the 
lattice and equal 1 outside of this block. Hence only nine out of the 192 
elements of the frame G are amplified, while the rest is unchanged, i.e., 

2, {k,l) G {i-p,...,i-l,0,...,p} X {l-p,...,f-l,0,...,p} 
1 , otherwise 



<^k,l 



where /c = 0, 1, . . . ^ — 1 and 1 = 0,1,...^ — ! and the parameter p equals 1. 

The weighted frame WG is presented in Figure U] in such a way that the 
atoms gk^i (each with 144 coefficients) are stacked along the y axis ("frame 
atom index"). The actual ordering of the frame atoms is arbitrary, because 
it does not influence the frame operator L. Here atoms with the same time 
shift, but different modulations, are stacked one alongside the other, starting 
with the smallest time shifts. 

Since the weights used are positive numbers, it suffices to display the 
absolute values of the atom coefficients {z axis on Figure in order to show 
the effect of the weights. However, as a side effect, the atom modulation is 
not visible anymore. Atoms which differ only in modulation are grouped in 
clearly visible bands containing d/b = 16 atoms each. 

It turns out that the inversely weighted canonical dual frame (iWDG) 
and the canonical dual weighted frame (DWG) yield almost identical plots. 
Thus we present in Figure [H the absolute value of the componentwise dif- 
ference iWDG-DWG between the two dual families. The only visible differ- 
ences are in the locations where the weight u> = 2 was applied (see Figure 

SD- 
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^1 JLiiJ.. i iLy - 



Figure 4: Nine elements of the frame G are amplified with the weight equal to 2 
while the rest remains unchanged. (Left) Positions of the amplified atoms in time- 
frequency domain (the plot is rescaled in order to group the marked points in the 
center). (Center) The resulting weighted frame WG. Note the "spikes" which are 
the amplified atoms around (0,0). (Right) Difference between iWDG and DWG. 
The most notable changes are located near the places where the weight cu = 2 was 
applied. 



Now we construct frames with iiigher redundancy by using the time- 
frequency shift parameters listed above and the different window functions. 
The same weight w is apphed to the new frames. The relative error of 
approximation of DWG by iWDG, measured in the Hilbert-Schmidt norm, 
is presented in Table El 



(a, 6) 


Gaussian 


Hanning 


Bartlett 


(12,9) 


0.0802 


0.0830 


0.0909 


(9,8) 


0.0808 


0.0858 


0.0908 


(8,6) 


0.0786 


0.0798 


0.0816 


(6,6) 


0.0751 


0.0779 


0.0796 


(6,4) 


0.0703 


0.0707 


0.0718 


(4,4) 


0.0638 


0.0665 


0.0680 



Table 2: The relative error of approximation of DWG by iWDG with respect to 
the Hilbert-Schmidt norm, in the case of Gabor frames weighted with the piecewise 
constant weights and a 3 x 3 block on the lattice. The redundancy increases with 
decreasing a and b. 



Next, let us change the number of amplified elements by increasing the 
size of the central square block on the lattice. The weight w equals 2 on this 
block and 1 outside. The size of the block (mask) changes from 3 x 3, 5 x 5 
to 7 X 7 and 9x9, hence the number of amplified elements of the frame 
G increases from 9, 25, to 49 and 81. For the case of a Gabor frame with 
a Gaussian window g and time-frequency parameters {a,b) = (12,9), this 
constitutes 4.7%, 13%, 25.5% and 42.2% of all frame elements, respectively. 
We apply the weights ujk,i with the parameter p = 2 for the 5x5 block, 
p = 3 for the 7x7 block and p = 4 for the 9x9 block. 

Figure [5] shows the results for the Gaussian window, for the other window 
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functions the results are very similar, hence we skip them here. The relative 
error of approximation of DWG by iWDG with respect to the Hilbert- 
Schmidt norm is presented as a function of the increasing block size. The 
simulations are repeated for the frames with higher redundancy. In each 
case, the error increases linearly with the size of the block on the lattice. 
The linear relation i; actions . 



Figure 5: Linear dependence of the relative error oj approximation on the mask size 
for varying redundancies. Increased mask size leads to a larger number of amplified 
frame elements and generates a larger error when approximating the canonical dual 
frame DWG with the inversely weighted dual frame iWDG. Higher redundancy leads 
to lower errors and this effect is stronger for larger masks. 



6.1 Interpretation 

The redundancy of the frame has a stronger influence on the error of the 
approximation of DWG by iWDG than the size of the applied mask. Inter- 
estingly the influence is almost linear. 

Another important factor is the choice of the window, but Gabor frames 
exhibit a remarkable indifference to the change of window in the situations 
we considered. Although the Gaussian window gave the best results, other 
window functions such as Hanning, Bartlett, Blackmann or B-spline win- 
dows of order 3 and 5 are only slightly worse. 

7 Perspectives 

For finding the optimal weights, further numerical tests should be conducted. 
In particular, a geometric classification of those frames, where the given 
weights work well or not at all, will be interesting. Furthermore, the Hilbert- 
Schmidt operator norm is easy to use for measuring the approximation error, 
but it would be more interesting to use the operator norm. This could be 
obtained, for instance, by using LMI algorithms. [8] 

The weights in Section [5] can be seen as a measure of the off-diagonal be- 
havior of the Gram matrix. It is well-known |14j that the cross-Gram matrix 
of the frame and its canonical dual, i.e., r, carries a lot of information 



• Redundancy 2.00 
■ . Redundancy 3.00 
» Redundancy 4.00 

Redundancy 6.00 

* » Redundancy 9.00 




0.0 
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about the frame. In further numerical tests, we will evaluate the weights 
using this matrix. 
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